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PREFACE 


This  report  publishes  the  results  of  an  investigation  of  the  costs  of  procuring 
peculiar  ground  support  equipment  (PGSE)  and  automated  test  equipment  (ATE).  It 
presents  data  on  a  number  of  items  of  such  equipment.  It  also  presents  the  results  of 
analyses  to  derive  cost  estimating  relationships  for  PGSE  and  ATE. 

The  work  was  supported  by  IDA's  fund  for  central  research.  The  report  was 
reviewed  by  the  Cost  Analysis  and  Research  Division. 

The  authors  gratefully  acknowledge  the  aid  given  by  the  Facilities  Equipment 
Branch  of  the  Air  Force  Logistics  Command,  the  Defense  Logistics  Services  Center  of  the 
Defense  Logistics  Agency,  and  the  Automatic  Test  Systems  Division  of  the  San  Antonio 
Air  Logistics  Center  in  providing  the  data  on  ATE.  They  also  wish  to  thank  Dr.  Stephen 
Balut  for  his  valuable  suggestions  and  comments  and  Mr.  Robert  Simmons  for  his 
substantial  contributions  to  the  form  and  style  of  the  report. 
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I.  INTRODUCTION  AND  FINDINGS 


A.  INTRODUCTION 

The  purpose  of  this  exploratory  analysis  was  to  develop  relationships  for  estimating 
the  procurement  costs  of  certain  items  of  support  equipment,  namely,  peculiar  ground 
support  equipment  (PGSE)  and  automated  test  equipment  (ATE).  The  first  task  was  to 
find  and  gather  data  on  the  procurement  costs  and  the  characteristics  of  the  equipment,  data 
which  could  be  of  use  in  developing  cost  estimating  relationships  (CERs).  This  was  a  time 
consuming  and  disappointing  phase  of  the  project.  Cost  analysis  of  support  equipment  has 
been  a  neglected  area  of  defense  cost  analysis,  and  the  armed  services  are  only  now 
beginning  to  construct  data  bases  with  consistent  and  complete  information. 

The  second  task  was  to  use  the  data  to  construct  CERs.  Using  the  data  sets  in 
Appendixes  A,  B,  and  C,  we  constructed  three  types  of  relationships-one  type  for  the  cost 
of  PGSE  and  two  for  the  cost  of  ATE.  In  the  first  type,  the  procurement  cost  of  PGSE 
was  related  to  the  quantity  and  unit  cost  of  the  aircraft  subsystem  the  PGSE  supported.1  In 
the  second  type,  the  cost  of  ATE  was  related  to  the  number  of  test  program  sets  (TPS)  used 
with  the  ATE  and  to  the  number  of  line  replaceable  units  (LRUs)  the  ATE  was  designed  to 
test.  In  the  third  type,  the  cost  of  ATE  was  related  to  the  characteristics  of  the  test 
equipment 

To  estimate  CERs  for  PGSE,  we  used  regression  analysis  and  historical  budget 
data  on  27  aircraft  that  were  being  procured  during  1970-85.  A  separate  regression 
analysis  was  carried  out  for  each  major  subsystem  of  the  aircraft-airframe,  engine,  and 
avionics. 

To  estimate  CERs  for  ATE,  we  used  regression  analysis,  again,  and  two  different 
sets  of  data  on  ATE  that  were  obtained  from  logistical  organizations  in  the  Air  Force  and 
from  the  Defense  Logistics  Agency.  In  the  analysis  of  the  relationship  between  the  cost 


This  analysis  was  an  attempt  to  provide  an  alternative  to  the  method  the  Office  of  the  Secretary  of 
Defense  (OSD)  uses  to  verify  the  services'  projections  of  aircraft  PGSE  costs:  calculating  the  ratio 
between  the  cos:  of  PGSE  and  the  cost  of  the  aircraft  and  using  these  historical  ratios  as  a  yardstick  to 
judge  the  reasonableness  of  current  PGSE  budgets. 
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and  characteristics  of  ATE,  separate  regressions  were  performed  on  different  characteristics 
of  the  equipment 


B.  FINDINGS 

The  study's  general  finding  is  that  the  costs  of  support  equipment  can,  in  fact,  be 
related  to  variables  obtained  from  the  kinds  of  data  bases  that  are  being  constructed  by  the 
services.  Our  results  offer  some  insight  into  how  such  costs  are  related  to  their 
determinants,  and  the  CERs  for  PGSE  are  reliable  enough  to  justify  their  use  for 
forecasting. 

The  study's  specific  findings  are  as  follows: 

1.  The  cost  of  procuring  PGSE  is  closely  related  to  the  quantity  and  the  unit  cost  of 
the  subsystem  the  PGSE  supports.  The  relationship  holds  for  each  major  subsystem  of  an 
aircraft-airframe,  engine,  and  avionics. 

2.  The  cost  of  procuring  ATE  is  generally  related  to  the  number  of  line  replaceable 
units  the  ATE  is  designed  to  test,  but  not  to  the  number  of  test  program  sets. 

3.  The  unit  cost  of  depot-level  ATE  is  closely  related  to  the  volume  of  the 
equipment  On  the  other  hand,  the  cost  of  ATE  is  poorly  related  to  the  equipment's  year  of 
installation  (a  proxy  for  year  initially  procured  and  thus  level  of  technology)  as  well  as  its 
weight,  surprising  findings  that  might  change  with  more  and  better  data. 
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II.  COSTS  OF  PECULIAR  GROUND  SUPPORT  EQUIPMENT 


A.  DATA 

To  estimate  the  CERs  for  PGSE  costs,  we  used  yearly  figures  on  procurement  of 

aircraft  and  PGSE  from  FY  1970  through  FY  1985  in  24  Navy  and  3  Air  Force  programs. 

2 

The  data  (Appendix  A)  are  given  by  major  subsystem: 

Quantity  of  aircraft  procured 
Airframe  costs 
Airframe  PGSE  costs 
Engine  costs 
Engine  PGSE  costs 
Avionics  (electronics)  costs 
Avionics  PGSE  costs. 

We  calculated  "total"  variables  hv  summing  the  yearly  figures  over  the  total  period 
for  each  subsystem  of  each  aircraft.  The  costs  were  escalated  to  constant  FT  1988  dollars 
before  summation. 

B.  COST  ESTIMATING  RELATIONSHIPS 

The  CERs  for  aircraft  PGSE  are  presented  below.  Only  20  data  points  were  used 
because  seven  of  the  aiicraft  programs  had  only  fragmentary  data  and  so  we  eliminated 
them  from  the  analysis.  Costs  are  in  millions  of  FY  1988  dollars.  The  independent 
variable  "AC"  stands  for  the  number  of  aircraft  procured.  The  figures  in  parentheses  under 
the  explanatory  variables  are  the  levels  of  statistical  significance  (calculated  from  t-statistics) 


Although  these  figures  were  obtained  from  budget  documents,  we  used  entries  in  the  "prior  year" 
column,  which  are  close  to  actual  expenditures.  For  example,  the  figures  listed  for  FY  1973  in 
Appendix  A  were  taken  from  the  budget  submitted  to  the  Congress  in  1975. 


for  the  regression  coefficients  (the  exponents).  We  used  an  exponential  specification 
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because  we  found  that  it  fit  the  data  better. 


Airframe  PGSE  cost 

=  .013  (AC)1’32 

1  19 

(unit  airframe  cost) 

R2  = 

.81 

(.1%) 

(.1%) 

Engine  PGSE  cost  = 

.097  (AC)'95  (unit  engine  cost)’65 

r2  = 

.84 

(.1%) 

(1%) 

Avionics  PGSE  cost 

=  .67  (AC)’85  (unit  avionics  cost)"78 

R2  = 

.88 

(.1%) 

(.1%). 

The  airframe  equation,  for  example,  relates  what  the  services  spent  during  1970-85 
to  procure  PGSE  for  the  airframe  of  an  aircraft  to  the  number  of  aircraft  procured  during 
the  period  and  the  unit  cost  of  procuring  the  airframe,  obtained  by  dividing  the  total  cost  of 
airframes  by  the  number  of  aircraft  procured.  The  equation  estimates  that,  given  recent 
budget  trends,  the  services  have  been  spending  roughly  $220  million  dollars  on  PGSE  to 
support  a  buy  of  200  airframes  costing  $10  million  each  (.013  x  2001'32  x  10119  =  $220). 

We  are  interested  in  how  well  these  equations  explain  the  data  used  to  estimate  them 
and  thus  how  well  the  equations  might  predict  the  future  in  the  absence  of  large  changes  in 
unmeasured  variables.  (Inflation  is  not  one  of  these  unmeasured  vairables,  since  all  costs 
are  in  FT  1988  dollars.)  The  R  of  .81  for  the  airframe  equation,  for  example,  shows  that 
the  number  of  aircraft  and  the  unit  cost  of  the  airframe  together  explain  8 !  percent  of  the 
variability  in  the  program  cost  of  the  airframe  PGSE.  The  predictive  powers  of  the  engine 
and  avionics  equations  are  even  higher. 

Moreover,  the  t-statistics  of  the  three  equations  show  that  the  numbers  of  aircraft 
and  the  unit  costs  of  the  airframe,  engine,  and  avionics  are  highly  related  to  the  PGSE 
costs.  For  convenience,  we  have  shown  the  levels  of  statistical  significance  rather  than  the 
t-statistics  themselves.  These  figures  show  that,  although  there  were  only  20  data  points, 
the  exponents  of  the  explanatory  variables  in  these  equations  pass  statistical  significance  at 
the  0.1 -percent  level  (except  for  the  1 -percent  level  for  unit  engine  cost  in  the  second 
equation).  In  empirical  studies,  a  10-percent  level  is  customarily  regarded  as  "good,"  a  1- 
percent  level  is  "excellent",  and  a  0.1 -percent  level  is  beyond  reproach.  In  other  words,  it 


The  CERs  in  this  paper  were  obtained  by  linear  regression  on  the  variables  transformed  to  natural 
logarithms.  To  obtain  the  equation  for  airframe  PGSE  cost,  for  example,  we  estimated  ln(airframe 
PGSE  cost)  =  a  +  b  lr.(AQ  +  c  ln(unit  a;rframe  cost)  and  then  took  the  antilog  of  the  result. 
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is  highly  unlike!^  .'iat  the  explanatory  variables  in  the  equations  presented  above  are  not 
predictors  of  iue  cost  of  PGSE. 

Given  that  we  are  using  exponential  relationships,  the  values  of  the  exponents  have 
a  simple  interpretadon  for  forecasting.  In  the  airframe  equation,  for  example,  a  10-percent 
increase  in  the  number  of  aircraft  procured  would  lead  to  a  13-percent  increase  (10  x  1.32) 
in  the  total  cost  of  airframe  PGSE.  Similarly,  a  10-percent  increase  in  the  unit  cost  of  the 
airframe  would  lead  to  a  12-percent  increase  (10  x  1.19)  in  the  total  cost  of  airframe  PGSE. 
The  fact  that  these  exponents  have  high  statistical  significance  gives  us  some  confidence  in 
using  these  relationships  to  forecast  the  percentage  change  in  PGSE  cost  associated  with 
changes  in  number  of  aircraft  procured  and  the  unit  airframe  cost. 

On  the  other  hand,  it  is  surprising  that,  in  contrast  with  engine  and  avionics  PGSE 
costs,  an  increase  in  the  unit  airframe  cost  and,  especially,  in  the  number  of  aircraft 
procured  should  lead  to  a  greater  than  proportional  increase  in  airframe  PGSE  cost. 
Because  of  economies  of  scale,  we  should  expect  that  an  increase  in  the  number  of  aircraft 
procured  would  lead  to  a  less  than  proportional  increase  in  PGSE  cost.  Further  research  is 
needed  to  examine  why  this  was  not  the  result  for  airframes. 


III.  COSTS  OF  AUTOMATED  TEST  EQUIPMENT 

A.  DATA 

We  constructed  two  data  sets  to  relate  the  costs  of  ATE  to  potential  explanatory 
variables.  Data  on  each  item  that  is  being  managed  under  the  Air  Force’s  Modular 
Automated  Test  Equipment  (MATE)  concept  were  supplied  by  the  Automatic  Test  Systems 
Division  at  the  San  Antonio  Air  Logistics  Center.  From  these  data  we  constructed  the 
variables  in  Appendix  B: 

Number  procured 
Unit  cost 

Number  of  test  program  sets  (TPSs) 

Number  of  line  replaceable  units  (LRUs). 

The  other  set  (in  Appendix  C)  includes  the  following  data  on  every  item  of  ATE 
stocked  at  depots  (Air  Logistics  Centers)  that  has  a  unit  cost  over  $100,000: 

National  Stock  Number  (NSN) 

Unit  cost  in  then-year  dollars 
Year  installed 
Volume  (cubic  feet) 

Weight,  for  only  a  few  items  (pounds). 

The  stock  numbers,  costs,  and  years  were  provided  by  the  Facilities  Equipment 
Branch  of  the  Air  Force  Logistics  Command.  We  grouped  items  by  NSN  and  used  their 
costs  and  installation  years  to  derive  a  single,  representative  cost  and  installation  date  for 
each  NSN.  Where  there  were  several  units  of  an  item  with  the  same  cosi  but  different 
installation  dates,  we  assumed  that  they  were  from  the  same  procurement  lot  and  chose  the 
single  cost  for  the  NSN.  This  cost  was  escalated  to  FY  1988  dollars  by  use  of  the  deflator 
for  "Other  Procurement,  Air  Force."  The  earliest  installation  date  observed  for  the  lot  was 
used  to  select  the  value  of  the  deflator. 

Because  the  level  of  technology  is  a  major  determinant  of  the  cost  of  equipment  in 
general,  we  sought  a  variable  to  capture  the  level  of  technology  of  the  ATE  and  used  the 
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earliest  installation  date  as  a  proxy  measure  for  this  purpose.  The  procurement  date  would 
have  been  a  better  proxy  for  the  level  of  technology  when  the  item  was  designed  and  built, 
but  it  was  not  available. 

Where  several  units  with  the  same  NSN  had  different  costs  on  different  installation 
dates,  we  assumed  that  they  were  from  different  lots  and  thus  represented  independent 
measures  of  cost.  We  escalated  each  cost  to  FY  1988  and  took  a  simple  average  to  obtain 
the  representative  cost  for  that  NSN.  The  First  installation  year  was  chosen  to  depict 

4 

technology,  as  before. 

The  Defense  Logistics  Services  Center  provided  the  data  on  volume  and  weight,  the 
latter  for  only  a  few  items. 

As  a  final  step,  on  the  assumption  that  the  relation  between  the  cost  and 
characteristics  of  ATE  varies  with  the  type  of  equipment,  we  assigned  each  item  to  one  of 
the  following  classes  and  used  dummy  variables  to  control  for  this  variable:  component 
(tube,  power  supply,  etc.),  Tl;  engine  tester,  T2;  electronic  subsystem  tester,  T3; 
maintenance  Fixture,  T4;  and  inertial  navigation  set  tester,  excluded  case. 

B.  REGRESSION  RESULTS 

The  equations  listed  below  show  the  results  of  the  regression  analyses  designed  to 

relate  the  cost  of  ATE  to  explanatory  variables:  in  Equation  1,  the  number  of  LRUs;  in 

Equation  2a,  the  volume  and  type  of  equipment;  and  in  Equation  2b,  the  weight  of  the 

equipment.  The  statistical  results  of  these  equations  are  poorer  than  those  of  the  CERs  for 

2 

PGSE  costs;  the  values  of  R  are  lower  and  the  measures  of  statistical  significance  are  not 
as  strong.  Moreover,  the  equations  do  not  include  several  variables  that  were  tried  and 
found  to  be  poorly  related  to  the  cost  of  ATE. 

1.  ATE  Cost  Versus  TPSs  and  LRUs 

The  results  of  this  analysis  were  as  follows.  Eight  data  points  were  used. 

ATE  cost  =  .23  LRU-61  R2  =  .35 

(10%) 


There  were  several  ’’mixed"  cases  in  which  some  items  came  from  the  same  lot  (had  the  same  costs)  but 
there  were  several  lots.  Here,  we  simply  took  an  average  of  the  various  lot  costs  in  constant  dollars. 
For  the  measure  of  initial  installation  year  we  selected  the  earliest  year  among  all  items  in  all  lots. 
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The  equation  shows  that  ATE  cost  was  somewhat  related  to  the  number  of  LRUs 
the  equipment  is  designed  to  test.  The  number  of  test  program  sets  is  not  included  because 
its  coefficient  had  low  statistical  significance. 

2.  ATE  Cost  Versus  ATE  Characteristics 

The  results  of  the  analyses  of  ATE  costs  and  characteristics  are  shown  be'ow. 
Eighty-one  data  points  were  used  in  the  first  analysis;  seven,  in  the  second. 

a.  ATE  cost  =  .302  (volume)'12  (,59)T1  (.22)T2  (.56)T4  R2  =  .23 

(1%)  (5%)  (5%)  (1%) 

b.  ATE  cost  =  .0169  (weight)'51  R2  =  .3 1 

(20%) 

We  can  be  confident  that  volume  is  a  predictor  of  ATE  cost,  since  its  exponent  is 
statistically  significant  at  the  1 -percent  level  (Equation  2a).  The  value  of  the  exponent, 
0.12,  implies  that  a  10-percent  increase  in  volume  leads  to  a  1.2-percent  (10  x  .12)  increase 
in  ATE  cost. 

The  levels  of  significance  of  the  dummy  variables  are  also  high,  which 
demonstrates  the  importance  of  controlling  for  the  type  of  equipment  in  future  work.5  The 
third  dummy  variable  (T3)  is  not  included  because  of  low  statistical  significance,  which 
indicates  that  electronic  subsystem  testers  have  a  similar  relationship  between  ATE  cost  and 
volume  to  that  of  inertial  navigation  set  testers,  the  excluded  case. 

The  year  of  installation  is  also  excluded  from  Equation  2a,  again  because  its 
coefficient  was  found  to  have  low  statistical  significance.  This  suggests  that  the  level  of 
technology  has  little  effect  on  ATE  cost,  a  somewhat  surprising  result. 

The  fact  that  weight  has  low  statistical  significance  in  Equation  2b  is  surprising,  in 
that  the  costs  of  many  defense  systems,  including  entire  ships,  are  estimated  by  applying 
cost-per-pound  factors  to  various  items  of  equipment,  or  weight  groups.  The  sample  size 
is  small,  however.  Note  also  that  the  volume  of  the  equipment,  which  proved  quite  reliable 
in  Equation  2a,  is  not  included  in  the  regression  expressed  in  Equation  2b  because  its 
coefficient  had  a  very  low  level  of  statistical  significance  when  weight  was  included.  This 


5  The  dummy  variables  for  the  types  of  equipment  were  entered  linearly  in  the  regression  equation: 
ln(ATE  cost)  =  a  +  b  In(volume)  +  c(Tl)  +  d(T2)  +  e(T4). 
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suggests  that  further  research,  conducted  with  more  and  better  data,  should  re-examine  the 
question  whether  volume,  weight,  or  both,  provide  better  predictions  of  ATE  cost. 
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APPENDIX  B 

AIR  FORCE  MODULAR  AUTOMATED  TEST  EQUIPMENT 
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